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FACIAL LI VENESS ASSESSMENT SYSTEM 

Has mvention relates to a system and method for assessing whether or not a 
subject's f^c is ibc face of a real Qive) peison. 

Prior art systems for use in facjaJ idaitificatioii systems, nwy sometimes be 
ptom to fraudwlent misuse by impostors. This occur whea an impostor 
attempts » w:i<j!c the system by preseraing a photograph or a video recording of 
the true cliesnt to the system. In some prior art systems die hnpostor's wterapt 
to gaia access k> the system ia This way may be successftU, and impostor 
will have gained access to the true clicm's system. Obviously, it is desirable to 
improve the security of the sysian to avoid this type of impostor attack. 
According to tiw inveaotioa there is provided a system for asses^g whether or 
not a subject's fece is the fece of a teal person, the system comprising; control 
means for controlling optical radiation incident on the subject's &,ce, detecting 
means &r detecting the optical radfaiitm reflected at flife subject's face* and 
processing means responsive to the conttrol means for analysing the reflected 
optical radiadon detected "by the detecdng means to assess whether or not die 
subject's face is that of a real person. 

In a preferred embodiroetit the control means includes a controllable optical 
radiation source (operating in the visible or infra-r©d region of the electro- 
magnedc spectrum) anranged to direct opdcat radiation seqx^tially under 
cKfferent illuminaticm conditions onto the subject's fece. 
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In this acrangemeuit the deieciing means wiU detect the optical radiation 
reflected by ihe subject's face each tiroc the jllumination conditions of the 
subject's face changes. 

The iUumiraliop conditions may be changed by altering the position of the 
conttollable optical radiatjoa source; ming the comroUable optical radiation 
source to illuminate dififerent regions of the subject's fece; changing the 
intensity «r the wavelength of the radiation emitted by the optical radiation 
source. 

In a preferred embodiment, the processing means deienmnes whether the 
subject's face is real by looking at the difference between the optical Tadiatioa 
detected by the detectwg means under the difierent illumbatiai conditions. 
In an aJternWlve embodmtent the corarol means comprises an optical radiation 
source for iUuminatrag the s«bject»s face and means to direct the siibjecc's gaze 
in different directions whilst the subject's face is Ulumiaated. Preferably the 
means to direct comprises weans to move a shape on a display screen placed in 
the subject's Une of sight, and *e deieciioa means detects the optical radiation 
reflected by the subject's &ce each thne The position of the subject's fece 
changes, as the subject's gazes follows the means to direct. 
In this embodiment the processing means determines whether the subject's face 
is real by looldng at differences between the reflected radiation detected by the 
detecting means for each different position of the subject's fece, as the gaze of 
the subject follows the means to direct. 
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According to tt^e invention there is also provided a ineiho4 for assessing 
whether or not a subject's face is tbe fkce of a real perscoi^ the mettiod 
comprising; providing optical radiation to be incident on tlie subject's face, 
detecting the optical radiation reflected at the subject'9 face, and analysing the 
detected optical radiation to assess whether or not the subject's face is that of a 
real person. 

Embodiments of the invention are now described, by way of example only, 
with reference to flie sole figure of the drawings. 

As can be seen from the fignre, the system typically comprises a monitor (UX 
a camera (10), a source of optical radiation (15) and a computear (20)- Tbe 
computer (20) includes processing meatus (12) md control means (13). The 
subject's face (I) whose genuineness is to be tested is positioned in &ont of the 
camera (10), 

The subject (1) undergoes the process of ^active UUroiination' whereby two 
images of the subject's face are .ctgjtwred sequentially by the camera (10) under 
di^erent iUtmunation conditians. ' 

In one embodiment of The invention, a first iUuminatioa condition is set up. Xa 
tiie first illumination condition Ihe source of optical radiation (1 S) of the system 
i£ configured to provide a controlled illimiinatian condition. In this case, the 
source (15) is a light source and the fece of the subjea (1) is illuminated by the 
light source (IS) and also by the ambient illumination conditions already 
existing. Hie particular illumination condition of the light source (15) (e.g. it$ 
mtenshy) can be controlled by the comroj means (13). An image of the 
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subject's face as illuminated wnder this first illuminatioa condition is captured 
by tbe camera (10), to be sujaseqiiently analysed by the processing means (12). 
A second iUwroination condition is then set itip. In ibis embodiment, this second 
illumindiion condition is obtained by removing the iiluminati^ pEx>vided by 
liie light source (15) and capmring an image of ?he subject's face as illuminated 
solely by die ambient iUuininaiion. Hie camera (10) captures an hnage of the 
subject's fece vinder the ambient iUurofaiation, for subse<iuent analysis by the 
processing means (12). 

The processing means (12) calculates a difibfence between the un^es obtained 
by the camera (10) under the two different illumination conditions. Generally, 
the illuroinsUon conditions are controlled such that objects in the background 
are not illuminated, leaving only the fece in the foreground illuminated. 
Corccction fat sHf^t movemwJts of the head betwerai image captures is done 
using standard rootlcm esthnation techniques. 

If the subject's face is thai of a real person, the *ditference image' obtaraed in 
this way will cjchibit certain dwracteristic features wlrich demonstrate that the 
face is that of a real person. Conversely, if the subject's fece is not to of a 
real person, bm is provided by a photograph or video recording, say, the 
'difference hnage' would not exhibit the characteristic features signifying the 
&ce of a real person, allowmg imposter aitacjcs and other non-faces to be 
detected. 

In the embodiment described above, the controlled illomination is provided by 
light source (15) such as a dedicated lamp. The illumination could 
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alternatively be provided by any other U^t-enaitting device, suOl. as a 
computer fisplay sarjwn, such as mooiior.CJ- !)• . I^i® ^ticsljcadiation jwovuied 
by source (15> or otiier iaeans xasey be fca the visibk teg^ofl, or ia infrasred 

AS described «Sjov€, in the first embodiro^t flie lUumixkatioii ootjijitioas axe 
dhaaged by simply turning off tbe light source (15) vjsed in the first 
illuminmiaii cpnditioa. Alternatively, the illununaxion conditi<ais coidd be 
dbani^ by chanjgins.the iJWeasity of the optical ra^adon emitted by the source 
(15). or by changing Use poaitiasL of the optical tswiiatioii source (15> .with 
' respect to the subject's facci or by changiag the wavelength of fte optical 
radiation ^tted by ^ optical radiation source (IS). 

Also, if the optical radiation is being provided by a lighc-enuiting device such 
as a computer scrBaa (H), it vxw be provided ii^ a pardowlar pattern which 
iUuminases different regions of subject's fece hi dlfFerem ways. It is 
possible CO use the control means (13) to change this patiacn, so that under the 
first ilhiminatian condition the si^ject's f»ee is iUuminated v?ith » Srst pmxem, 
and under tiie second iUummation condition the si:^bject*s face is illuminated 
with a secOTd, difBsrent pattern. 

It is also possible tbW the pattern provided to iUuminaae the subject's fece is ft 
moving pattetn. Each time the pattern moves the iUumination condition of the 
subject's fece is cdianged, so different ji^ons of the subject's face will be 
muminaiEd. Hie camera (10) takes an image of dse subject's fece each tUne 
d^e pattern moves and changes tite iUumination condition. 
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Iti the embodiments previously described the subject's face is illuminated 
sequet^tially wder Grst mi second cUfferent illumiAacon conditions. It is 
entirely possible to illuminate the f^ce under a series of different iUumin^ion 
conditions and obtain several ^diffeiwce iamges' which can be used to 
deteitnine if the subject's ^e is a real &ce. 

Ill m ^temativfi embodiment ofth^ inventi<w, a guide icon (14) is provided on 
ib^ $cr?en of moiuta^ (1 1). The zllmnination ccnaditions provided by tiie opUcal 
radiation source CI 5) (or nxoniior (X 1} ) are maintained at constant level as liw 
po$ifion of ttie guide icon (14) on the screen changes* The subject (1) is 
instructed to move Their gaze so that they follow the movement of the guide 
icon (14) «ound the monitor (11), The camera (10) takes an im^e of the 
subjecrs face each time the position of the guide icon (14), and therefore the 
position of the subject*s face, .changes. The processing means (12) receives 
each image and analyses ^ 4i£fer»ces between the imagesp The dif&rences 
between the images can be used to determine whether the subject's face is that 
of a re^d person, as described earlier. 

ta all of the embodiments herein described the processing means analyses the 
radiation reflected at the subject's face vmder the diffemit illuminatim 
conditions to produce a 'difference image', The ^difference image' is analysed 
to determine if the subject's face is ^ face of a real persoii It is possible ihat 
the optical radiation is reflected at the subject's face, and then detected* but that 
a ''difference image' is not produced. Instead the processing meai^ analyses 

6 
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*e refleisted optical radiioi'oii- in another way. numerieaUy. for example, to 
deiermine if the subject's face w ?baT of areal person. 

Ojsce i3ie system has'deticiTOined vshethja: the subject's face is that of a leal 
person* tbs subject pan theu have their idemity verieed by a ^ce veriflcation 
systwtt such as ttjac described in PCT pubUcaiion WO 01/91041. 
In a fece vaificadon ^yston are gen«ally sesvwal processing stages. 
Firstly,.lhe image of the cUeta is 'grabbed' by *i wineta, for example. Then the 
position of the face wiihin the image has to be identified «a4 localised. Once 
_ ^ fqce has been localised the image has to be nonnalised for iUumination and 

geomettie transformations. This enable? a suitable represenraiian of the fece to 
be computed befijre Ilifi identity of the fece is finally veriJaed, 
All of these different st^es are very sensitive to die iUmnination con(Utiorts at 
the time particular image of the subject's face is obtained. In some cases, it 
is not uncomman for the snfajcct to be falsely r^ected, <a for an impostor to be 
incorrectly accepted due to small UQcpniroIled variations in the illwnination 
conditions. 

If tbe iQuminatiOn conditions aze known at all times dien the overall 
paformance of the system will improve, and the iUurainadon of the fitce can be 
carefully cotwiolled- during the acquisition of images. The sysiem described 
with refercQce to ihe figure could be used, to provide such controlled 
illuminadon conditions for use in &cial verrficaiion system. 
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CLAIMS 

1. A system for assessing whetbep or not a subject's fece is the feoe of a ' 
real parson, the system compriBiiig;. control means for controUing optical 
radiation incident on tbe subjects face, iteteeting means for deieaing ppdcal 
rsuU^OQ reflected at tiie siil>ject*5 &oe, and processing means responsive to tfte 
contbl means for anAlysiiig the reflected opt^ radiation derecied by llw 
detecting means to assess -wlu^ier or not the sufaject's ^loe is that of a real 
person. 

2. A system as claimed in clairn I wherein said control means includes ft 
comtoUable epical radiation source. 

3. A system as claimed in claim 2 wherein said oontfoUable optical 
radiation source is arranged to direct optica radiaiitm sequentially under 
different illvuninatian conditions- onto H» snbject^s &ce. 

4. A system according to claim 3 wberdn the cootroUatde optical radiati<m 
ionrce directs c^cal radiation, onto the subjeet's fece mider a p^cular - 
iUominatipn condition, the • detecting means detects the optical radiacioa " 
reflected at ihe sidiject's face nndw the particnlar illumination condition, the 
controllable optical radiation source then directs optical radiation onto the 
subject's fee© «nd«r a different Ulnmination condition and the detecting means 




I 



16-07-03 04:02PU FROkHlathl Ban Macara 6 Co . T-rSO P.14/22 F-9B8 

\ 

detects the optical radiation reflected m the subject*s im4er said differeut 
UluiniwBtlon conditioti. 

5. A system accordii^ to claim 3 or claim 4 wherew thfr position of said 
coatroHflble optical rtdi«don source with respect lo Ibe subject's face is • 
ctvawged to provide tJte di£6»eat illuminatioa conditions. 

6. A system accordingly to claim 3 or cteim 4 -whwein said conttoUable 
^ ■ optical Tadiation source is arranged to direct onto differeii: regions of the 

subject's feoc to provide diEferent iHuminatten conditions. 

7. AsyaemaccordiiJ^tocW? or cMm4wlwireintheintensity ofti^ 
opdcal - radiation emitted by said controllable optical radiation sonrce i» 
changed to provide tlie (Ufferenc illumination conditions. 

8. A system according io claim 3 or 4 v(*eiei» the wavelength of the 
optical radiation OTiitted by ssdd controllable optical radisiion source is 
changed to provide the ^^iferent illumination conditions. 

9. A system according to any of claims 3 to S wherein the processing 
means detennines -whcdier the 5utgec«*s fece is real by analysmg a difference 

• between the reflected optical radiation detected by the detecting means under 
the diSerent illomination cbnditiCHis. 

9 . 
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10. A system as clftimecj ia* claim 1 wherein said control means comprises a 
eonirollable apdcal radiation source for illummaTtog *te subject's fare and 
means to direct the sulaect'&.gaze in diff^eni directions whilst the subject's 
&ce is ilhitmn^ted, 

11. A systm as claimed in claim 10 wb^rein s^d m«ans to direct compiise^ 
means to move a shape on a display screen placed in Ibe subj^t^s line of sight* 

12. A system according to claim 1 0 or claim 1 1 wherein the detecting means 
detects optical radiation reflected at the subject's face each time the position of 
the subject's face cfianges, as the sulgect's gaze follows the means to direct. 

13. A system according to claim 12 wherein &e procefiSing means 
detertmnes whetljer ihc subject's f^e is by analysing differences between 
ihe rcAsGted rddiarion detected by the deiming means for ea(^ different 
position of the subject's face, as fhe gaze of the- subject changes to follow the 
m^^m to direct. 

14» A system aqcordirig to any preceding claim wh»ein the controllable 
optical radiation source operates in the visible region. 
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15. A system according to any of cJ^ims I to 13 wberem the conlroUabk 
optical ladiatjon source operates in the in&a-re4 region, 

16. A system accordkjg to any pjreceding claim wheieiiv the controllable 
(^tical radiatioa source is a dedicated light aoiiice. 

17. A system according to aay of claims 1 lo 15 whereiji the controllftWe 
optical radiation source is a light eBindng display device. 

18. A system according To claim 17 "vtoein the light emltdng display 
device is a computer monitor. 

19. A system according to any preceding claim wherein the detection means 
is a camera. 

20- A fecial verification system incltuKng a system for assessing whether or 
not a STJhject's face is the face of a real person according to any preceding 
claim. 

21. A method for assessing whether or not a snbject^a face is the fkce of a 
teal person, the method comprising; cawing optical radiation to be .ioddeni on 
the subject's face, detecting the optical radiation reflected at the subject's face, 

11 
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and analysing the 4«ected optical raaiaiion tci assess whether or not thfe 
subject's f^pe is that of a real person. 

22. A mediod as claimed m claim 70 v\*erein said optical mdiation is 
provided by a conirol means, ijicludmg a controllable optical radiation source. 

23. A method as claimed in claim 22 wheroia said coniroUable optical 
xadiauDTi sox^ree is airanged to direct said optical radiation sequentially vnder 
di£ferent illuminaticcft conditions onto the subject's face. 

24. A method according to claim 23 hicludlng the ^teps of directizig. said 
optica] radiation from the controllable optical radiation source onto the 
subject^s fac^ under a paiticular illumination condition* detecting the optical 
radiation reflected at the subject*^ fece under th$ particular illumitiation 
coqndition, directing said optical radiaci<m &om the comroUable optical radiatioa 
source onto the subject's face under different illummation conditions and 
detecting said optical radiation reflpcted at the subject's face imda the different 
illumination conditions. 

25. A mefliod accoirding to claim 23 or claim 24 wherein ti>e position, of the 
controllable optical radiation source with respect to the subject's face is 
cbange<l to provide tiie different illumination conditions. 
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26. A meibod according to cl^im 23 or claim 24 wherein the controllable 
Optical radiation souxce is attanged to direct optical radiaxioa onto different 
regions of flie subjects fece to provide different illwmnation conditions. 

27. A method according to claim 23 or dmsn 24 wh^ein the intensity of the 
optical radiation emitted by the controllable optical racUation source is changed 
CO provide the difforeat iUumioacion condition?. 

28. A method according to claim 23 or claim 24 wherein the wavelength of 
the optical radiation emitted by the controllable optical radiariou source is 
changed to provide the different illumination conditions. 



29. A qaethod according to any of cladras 23 to 28 including the step of 
determining whether the wbject^s fece is real by analysing the (Mffference 
between die reflected opticel radiation detected under the diffCTent illwmnation 
conditions. 

30. A method a^ cl^ed In claim 21 including the sxep of directing tbe 
subject's gaze in different directions whilst the subjects face is illmninated by 
said optical radiation. 
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31. A meijiod as claimed in claim 30 wheran the st^ of directing the 
subject's gaze is p^omed by moviag a shape on a display saxsca placed in 
the subject's line of sight. 

32. A meftiod according to claim 30 or claim 31 whereiw said optical 
radiafion reflected by the aobject' s fece is detected each lime the position of the 
subject's face ctoges, as the s«bjeCT*s ^e is directed in different directions. 

33. A method accoiiding to claim 32 including the st^ of de^srminiog 
whether the subject's face is real by analysing the diffeceuces between tbe 
reflected radiation detected fbr each difTerem: position of the subject's £»ce, as 
the gaze of ^e subject is directed in difterem directions. 

34. A method according to any of clmms 21 to 33 wherein th^ optical 
radiation provided on the subject's fkce is in the visible region. 

35. A method according to any of claims 21 to 33 wboein the optical 
radiation provided on tbe subject's faee is in ^ infirarted re^on. 

36 A system substantiaMy as herein described with tefraence to the 
accompanying figure. 
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37. A method substantially as beisin described with reference to tbe 
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ABSTRACT 

A system for assessing whe&ec or not a sulgeci's fiace is a teal face is 
described. Tbe face of the subject is illuminated under different iUiuninaticHi 
conditions, and images of the subject are obtained for each diffeteat 
Ulominatum condiaon. The differ^ce between the images obtained iff. 
difEerent illuminaiioa ccmditions cwa be used to detenmoe if the subjecc^s &ce 
is the £ace of a real person. 
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